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(54) Abstract Title 

Syntax error correctioi> in an MPEG data stream 

(57) An Incoming data stream which is in MPEG format or is to be converted to MPEG format is parsed to 
detect coding parameters and any errors in the syntax of a macroblock or slice are detected and the block or 
slice is replaced by a predetermined block or slice having acceptable syntax. 

The error may occur in the header or data block and correction may occur before or after variable length 
decoding. The predetermined block or slice may represent black or a grey level. 

The Invention finds particular application In MPEG to SX conversion which is appropriate for recording 
on video tape in compressed format where MPEG coded signals would be Incorrectly replayed at 
non-standard replay speeds. 
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The present invention relates to a stream processing technique, and more 

I 

particularly, to such technique for correcting a syntax ciior in an source encoded 
data stream. 



Several types of formats for recording a digital video signal on a recording 
medium and transmitting are available. However, since a digital video signal may 
have a relatively large amount of data, the video signal may be compression encoded 

15 so as to enable data corresponding to a relatively long playback period to be recorded 
on a recording medium. An example of a compression encoding method is a so- 
caUed MPEG (Moving Picture Image Coding Experts Group) method which is a 
hybrid method wherein motion-compensation predictive coding and discrete cosine 
transform (DCT) coding are combined. In other words, redundancy m the time 

20 domain is reduced by taking a difference between frames of a video signal and 

redundancy in the spatial domain is reduced by the use of discrete cosine transform 
(DCT) to efficiently encode the video signal. 

In a video tape recorder, which uses a tape-shaped recording medium such as a 
magnetic tape recording medium, a recording process may be perfonned in which 

25 tracks disposed at an angle to a tape running direction (so-called helical tracks) are 
formed with the use of a rotating head. When such tape-shaped recording medium 
having helical tracks is reproduced at a speed higher than a normal tape running speed 
such as two times the normal speed (double speed) or three times the normal speed 
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(triple speed) or such as that in a search function, since the trace angle of the rotating 
head on the tape becomes different from the angle of the recording tracks, all of the 
signals recorded in the helical tracks may not be reproduced. In other words, during 
high speed reproduction, the video tape recorder may not reproduce all data elements 
S recorded in the helical tracks, and instead may only reproduce some of such data 
elements. 

Since an arrangement of data elements (such as DCT coefficients) of a MPEG 
stream generated by a MPEG encoding method is not considered such a high-speed 
reproduction of the video tape recorder, such arrangement of data elements of the 

10 MPEG stream may not be suitable for a tape recording medium. Therefore, if a 

MPEG stream recorded on a tape recording medium is reproduced at a high-speed, the 
reproduced video stream may not have all of the data elements. As a result of such 
reproduction, it may be difficult to obtain a high-quality image with an effective use 
of the reproduced stream. 

IS Therefore, it may be preferable to use an encoded stream format which allows 

image reproduction to be performed effectively even in high-speed reproduction, 
instead of the MPEG encoded stream as a compression encoding method for a tape- 
shaped recording medium. In consideration thereof, a so called "SX stream" or 
"Betacam-SX stream" has been proposed which is suitable for high-speed 

20 reproduction. 

The SX stream is generated by a SX encoder which utilizes a hybrid encoding 
technique which includes motion-compensation predictive coding and discrete cosine 
transform coding similar to that of the MPEG encoding method. Accordingly, the SX 
stream generated by the SX encoding method follows the MPEG standard. However, 
25 the SX stream and the MPEG stream differ in the arrangement of DCT coefGcients in 
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d,. «,«Ki«l sttcam. Sp^iflcaUy. wiU, „g„d «, a„ dcT coefficient, u> ceate a high 
^Uy in«ge during u,e high-speed reproducUon. d.e DC elemen. »<, AC element 
having lower spaUal frequency n,ay be considered n>ore important than the AC 
elementshavinghigherspa.ialfi«,„ency. A. a result, h, the SX stream, AC element, 

. of^'-^coefficientsin.hemaaoblodcarere^nngedinspadalftequencyord.r 
ftom lower spatial frequency to higher spatial ftequency. 

Tlus, although the SX stream is compliant with the MPEG standard, the SX 
stream is not the same as a MPEG stream and is s»it*le for high speed reproduction 
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When «, encoded stream is ,0 be transmitted to a MPEG device, it may be 
pteferredtousea MPEG stream as the transmitting stream. On the other hand, when 
an encoded stream is to be recotded onto a tape medium, it may be preferred to us. a 
SX stream as the recording stream. In considetation thereof, a stream processfag 
apparatus for processing a source en»d«, stream so as to convert a stream structut. 
.5 from that of a MPEG stream to that of a SX stream or tan that of a SX stream to U.at 
of a MPEG stream has been proposed. Such stream processing apparatus is descdbed 
inUS. patent appUcationSerialNo. 09/283.034 ffledAptil 1, 1999. Whenst^am 
P-cessing is performed on a source e.«ded stteam by using such str«m, processing 
apparatus, it may be necessary to pats, the syntax of the source enc»d«l stream to 
20 extract the coding parameters. 

However, if a syntax «™r occut^d in the source encoded stream, the syntax 
Of the source encoded stream will no. be able to be correctly parsed or variable- ' 
icngd^-decoded. When prohibiUve coding pa,»..ters. non-detetmined coding 
parameten, or contradiction coding parameters are included in the source encoded 
25 stream,as,n.axe,rormayoccur. Also, when the source encoded stream todudes 
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data elements not corresponding to the variable encoding table, data elements which 
are interrupted, or data elements not having a predetennined data length, a syntax 
error may occur. As a result of the failure of the parsing or the variable-length- 
decoding process due to a syntax eiror. the above stream processing apparatus may 
not operate properly. 

Furthennore, since a MPEG stream comprises a variable-length encoded 
(VLC) code stream, if a syntax enor occurs in one respective macroblock in a slice 
layer, a plurality of macroblocks after the respective macroblock may not be properly 
parsed or variable-length-decoded. 

An aim of the present invention is to provide a stream processing technique 
which may better process a source encoded stream containing a syntax error in a 
source parsing operation. 

In accordance with an aspect of the present invention, a stream piocessing 
apparatus is provided which comprises a parsing device for parsing a syntax of a source 
encoded stream to extract a plurality of coding parameters from the source encoded 
stream, a detecting device for detecting an error macroblodc having a syntax error in the 
source encoded stream in accordance witii a result of a parsing process performed by the 
parsing device; a variable-length-decoding device for performing a variable-length- 
decoding process on the source encoded stream to generate a variable-lengtii-decoded 
stream; a generating device for generating a predetermined macroblodc having a correct 
syntax which conforms to a motion picture image coding experts group (MPEG) 
standard; and a substituting device for substituting the predetermined macroblock ftom 
the generating device for the error macroblock of the variable-length-decoded stream. A 
corresponding method is alsc- provided. 
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Urn « fcaa p„,.™, eaAodtaei«s operate by subsdmttog a macroblockfc) 
tav,i« <he symax error aHl/or a macroblo<*(s) which wfll no. be parsed or variable- 
tei^th-decoded correcdy due u, the syma;c error wW. a predetermfaed macroblock(s) 
having a correct syntax. 

Embodiments of the invention will now be described, by way of example only 
with reference to the accompanying drawings in which: 

m accordance with another aspect of the present invention, a stream processing 
apparatus is provided which comprises a parsing device for parsing a syntax of a source 
encoded stream to extract a plurality of coding parameters from the source encoded 
stream a detecting device for detecting an error layer having a sjoitax error in the source 
encoded stream in accordance with a result of a parsing process performed by the 
parsing device, a variable-length^ecoding device for perfomiing a variable-length- 
decoding process on the source encoded stream to generate a vaiiable-length-decoded 
stream, a generating device for generating a predetermined layer having a correct syntax 

wMd, conforms to a motion picture image coding experts group (MPEG) stan^ 
substituting device for substituting the predetermined layer from the generating device 
for the error layer of the variable-length-decoded stream. 

Embodiments of the invention win now be described, by way of example only, 
with reference to the accompanying drawings in which: 
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Fig. 1 is a diagram of a video cassette recorder to which an embodiment of 
the present invention is applied; 

Fig. 2 is a diagram of stream conversion sections of the video cassette recorder 
of Fig. 1; 

Fig. 3 is a diagram of a data structure of an encoded stream; 

Figs. 4A and 4B are diagrams of a slice layer of a picture and an encoded 
stream of the slice layer; 

Figs. 5A-5F are diagrams to which reference will be made in explaining 
encoded stream substitution processing performed by a variable-length-decoding 
section; 

Figs. 6A and 6B arc diagrams to which reference will be made in explaining 
encoded stream substitution processing performed by variable-length-decoding 
section; 

Figs. 7A and 7B are diagrams to which reference will be made in explaining 
encoded stream substitution processing performed by variable-length-decoding 
section 21; 

Figs. 8A and 8B are diagrams to which reference will be made in explaining 
stream substitution processing performed by variable-length-decoding section 21; 

Figs. 9A-9C are diagrams to which reference will be made in explaining 
encoded stream substitution processing performed by variable-length-decoding 
section; 

Fig. 10 is a diagram of the variable-length-decoding section according to an 
embodiment of the present invention; 
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Hg. U is . diagr™ Of U» vrtable-lengUHiccoding s.«io» accoriing to an 
embodiment of the present invention; 

Figs. 12A.12F are diagrams to which reference wiU be made in explaining a 
hierarchical structure of a MPEG stream; 

Figs. "A-13F,redi^»wUchr.f«encewiUben.ad.i„«p,atoi„ga 
hierarchical structure of a SX stream; 

Figs. 14A and 14B are diagrams to which reference wiU be made in explaining 
an eitor condition in a coefficient stream of a MPEG stream; 

Figs. ISA and 15B are diagrams to which reference wiU be made in explaining 
10 an error condition in a coefficient stream of the SX stream; 

Figs. 16A-16D are diagrams to which reference wiU be made in describing a 
Stream conversion operation; 

Fig. "isaflowcha«ofabi..rateconversi<«p™c«»i„gperfon„«,i,a.. 
Stream conversion sections; 

" Kg-lSisadiagrajnofastufflngseclion; 

Fig. 19 ia a diag™ u> wiUch «f«nc. win b. made in «pUining «ufftog 
processing perfonned by the staffing seaion; 

Fig. 20 is a diag^n. to which «f„enoe will be made in explaining a startle 
emulation p,evendngp,o«ssi„gpertbrm«i by the stream inversion s«Uons; 

Fig. 21 is a diagram „, a portion „Ut.d to the stan^ode emulation preventing 
Proc^ to a header addition section of the stream convetsion section shown in Fi<, 
2; and 

Fig. 22 is a diagram to which reference wil, be made in explaining start-code 
emubtion preventmg processing performed in the stream convetsion sections. 
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Fig. 1 illustrates a video cassette recorder to which an embodiment of the 
present invention is applied. Such video cassette recorder includes a recording 
section and a reproducing section. The recording system of the video cassette 
recorder wUl be initially described below. 

A serial digital interface (SDI) section 1 receives source serial data SDI IN in 
which a video signal and an audio signal are multiplexed. The SDI section 1 
separates the source serial data SDI IN into a video signal VIDEO IN and an audio 
signal AUDIO INI, and supplies the video signal VIDEO IN to a SX encoder 
(SX_ENC) 2 and the audio signal AUDIO INI to a delay section (DL) 3. 

The SX encoder 2 applies compression encoding to the received video signal 
VIDEO IN to generate a SX stream SX ST in accordance with a predetennined SX 
encoding algorithm. The SX encoder 2 supplies the SX stream SX ST to an error 
correction code (ECQ encoder (ECC_ENC) 6. The delay section 3 delays the audio 
signal AUDIO INI corresponding to the source video signal VIDEO IN by an amount 
corresponding to the time for encoding the source video signal VIDEO IN by the SX 
encoder 2. A delayed audio signal AUl is supplied to the ECC encoder 6. 

A serial digital transmitting interface (SDTI) section 4 receives a source 
SDTI signal SDTI IN in which a MPEG encoded video stream and an audio signal are 
multiplexed, and outputs the MPEG stream MPEG ST to a stream conversion section 
5 and outputs the audio signal AUDIO IN2 to the delay section (DL) 3. 

The stream conversion section 5 performs stream processing so as to convert 
the MPEG stream MPEG ST mto SX stream SX ST, and supplies the SX stream SX 
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ST . ECC ^ (ECCEKQ 6. ae,ay «cUo„ 3 delays U.. ,„«o 
"AUDIO IN2.. co^po^, ,„ ^ ^ 

s«:tio„ 5. A delayed audio signal AU2 is s„ppU«i » u.. ECC encoder 6. 

Tie ECC encoder 6 appUes e^r «>n.«io„ coding ,o U,e SX sTean, SX ST 
and .he .«dio signab AUl or AU2 so - U> generate recording dau REC DATA and 
supplies U„ sa^ue .0 an e,ua,i«r (EQ) 7. l^e «,uaUzer 7 convert .he recording da.a 
REC DAT» arccording Signal RECRFandsuppUcs san,e «,a™.a«ngd,™„ 
(1>RUM)8. ^'o-'ingdrun.SsuppUestt.e.eceivedrecordingsignalRECRF^ 
10 fceads so as «> be recorded on a magneucupe (TAPE) 9. 

Tie sm.cn.« Of U>e reproducUon sys«n, of U,e video casse„e recorder ^ 
now be described. 

A reproduction head of U,e ro««ng drun. 8 reproduces da.a recorded on U,e 
magnetic .ape 9 and ou.pu.s a reproduced si^ PB RF ... , ^ 

" '^"^'PP'-.^-^.ualizationprocessing.oU.er.producedsig^PBRFso 
as .0 produce reproduced da.a PB DATA and suppUes ti.e sa.,e .o an ECC decoder 

(Ea:.DEC)10.Tl»ECCd.coderI0perfonnserrorco.rectiondecodingonti„ 
reproduced data "PB Data " 

FB DATA and separates the san,e into a reproduced SX stream 

"SX ST" and reproduced audio data AUPB TheErPH..^^ ,n 

^ijro. 1 ne £CC decoder 10 supplies the 

20 reproduced SX stream SX ST to a <;y^. ^ 

to a SX decoder (SX_DEQ 11. a serial digital 

transmitting interface (SDT^ section 14, and a stream conversion section 15 

Additr-onaUy.theECCde«>derlOsuppIiesthereproducedaudiodataAUPBtoa 
delay section 13. 

Tl.. SX decoder U decodes U,e reproduced SX suean, SX ST in accordance 
- "^•^"-■'^SXdecod.ngal^ritiun.whichn^yhesuhs.anti.lyopposi.e. 
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the SX encoding algorithm performed by the encoder 2, and suppUes the decoded 
video signal to a serial data interface (SDT) section 12. The delay section 13 delays 
the reproduced audio data AUPB by an amount corresponding to the duration of the 
SX decoding process performed by the SX decoder 11 and outputs a delayed audio 
signal AUDLl to the SDI section 12. 

The stream conversion section 15 converts the reproduced SX stream SX ST 
having the SX format into a MPEG stream having a MPEG format and suppUes the 
same to a serial data transmitting interface (SDTI) section 16. TTie delay section 13 
also delays the reproduced audio data AUPB by an amount corresponding to the 
duration of the stream conversion process performed by the stream conversion section 
15 and outputs a delayed audio signal AUDL3 to the SDTI section 16. 

The SDI section 12 generates a SDI signal by multiplexing Oie received video 
signal VIDEO OUT and audio signal AUDLl. The SDTI section 14 generates a 
SDTI signal by multiplexing Uie SX stream SX ST received ftom the ECC decoder 10 
and an audio signal AUDL2 received from the delay section 13. The SDTI section 16 
generates a SDTI signal by multiplexing Uie received MPEG stream MPEG ST and 
audio signal AUDL3. 

Fig. 2 Ulustrates stiream conversion sections 5 and 15. As shown therein, each 
of the stream conversion sections 5, 15 may have a variable-lengtii decoding (VLD) 
section 21, a conversion section 22. a variable-lengtii-encoding (VLC) section 23. a 
header addition section 24, a stufBng section 25 and a system control section 26. 

The variable-lengtii decoding section 21 parses the syntax of the source 
encoded stream to extract a number of encoding parameters and data elements, and 
performs a variable lengUi decoding process on the extracted coding parameters and 
data elements. GeneraUy, an encoded sti-eam which conforms to a MPEG standard 
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toclud^ v«iable.|«,ga dau obWncd ftom a variable lenga, ..ccdtog 

proems and fixed lengO. data element no. chained ftom a variable lengO, encoding 
proems. He variable-IengU, decoding secUon 21 peribm.s a variable length deciding 
I^ocess only on .he variable-lengU. daea element, ^„dcI coefflcien.,. in 
5 Kcordance with a variable lengih coding table. 

Fertile, the variablMength decoding section 21 detects a synta. etror in the 
soutceencodedstrean, based onares«..o,thep.,sh.gp„>cess. If the son« encoded 
sTean, includes a syntax «,or, .he variable-length decoding section 21 may substitu,. 

or replace ^J™"" etror with a co«c. syntax so as u, g««rate an encoded stream 
10 STRMl having no syntax error. 

TTe conversion section 22 perfomis a strean conversion p«Kess on ti,. 
»«» encoded streao, STOMl so as tachange a sm.cture of sonrce encoded stream. 
For example, if .he source encoded stream is a MPEG stream, it will be convened into 
a SX stream by the stream conversion process of the conversion secUon 22. On the 
15 otire, hand, i, the som« encoded s«eam is a SX stream, it will be converted into a 
MPEG stream by fte sf^m convert,, p„«ess of ti» conver^n secdon 22. 

Tie conversion secdon 22 also perfom» a bit ra.. changing process on the 
source encoded stream STRMl in a<«>rdance with a control signal CUT supplied 
ftom the stuffing section 25. For example, when the control signal COT has a value 
» of "1 U,e conversion seaion 22 may change one or more non-zero AC components 
baving high spatial fte,„«,cy to zero. As a resul, the conversion section 22 may 
control Ibc bit rate of output bit stream STRM2. 

Tire variable.l«,gth encoding section 23 applies a variable lengti, encoding 
P-ess .0 the stream STOM2 to generate a stream s™3 having a plurality o, 
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coding parameters which are variable-length encoded by use of a variable length 
encoding table. 

The header addition section 24 receives the stream STRM3 from the variable- 
length encoding section 23. The header addition section 24 prepares a pluraUty of 
coding parameters as header information of an output stream based on whether the 
source encoded stream is detected as a MPEG stream or a SX stream. Because the 
header information of each layer of a SX stream is different from that of a MPEG 
stream, the header addition section 24 may generate header information suitable for 
the SX stream or header information suitable for the general MPEG stream. The 
header addition section 24 adds the generated header information to the header areas 
of the stream STRM3 so as to form a stream STRM4 and outputs the same to the 
stuffing section 25. 

The stuffing section 25 receives the stream STRM4 from the header addition 
section 24. and calculates a data amount or length of a group of pictures (GOPs) of the 
stream STRM4. If the calculated data amount of a respective GOP does not equal a 
predetermined value, the stuffing section 25 inserts stuffing bits or zero data into the 
area provided before the predetermined start code of the stream STRM4 so as to 
increase the data amount of the respective GOP. On the other hand, if the calculated 
data amount of the respective GOP exceeds a predetemined value, the stuffing 
section 25 outputs the control signal CUT to the conversion section 22 so as to 
decrease the amount of bits in the respective GOP. 

The system control section 26 generates a control signal SYS_VLD and 
supplies such control signal to the variable-length decoding section 21 so as to control 
the same, generates a control signal SYS.DIFF and supplies such control signal to the 
conversion section 22 so as to control the same, generates a control signal SYS_VLC 
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and suppU« such c™«,l signal ,o ftc variabte-lcgth-encodtog section 23 so as to 
control the same, generates a control signal SYS.MKHD and suppUes such control 
signal to the header addition section 24 so as to control the same, and generates a 
control signal SYS.STOFF and supplies such control signal to the sn^ section 25 
5 SO as to control the same. 

•me encoded stream processing for correcting a syntsc error in the source 
encoded stream wiU now be described. Such processing may performed by the 
valuable length decoding section 21 of the stream conversion secUoas 5. 15. 

As shown in Fig. 3, the encoded stream may comprise a sequence layer, a 
.0 number of GOP (Group Of Pictures) Uyets. a number of picture layers, a number of 
slice layers and a number of macroblodc layers. Tl„ sequence layer may include a 
sequence.header.code (SHQ. header data including a plurality of coding parameters 
and a plurality of GOP layers. The GOP layer may include a group.start.code (GSCX 
header data including a plnraUty of coding parameters and a pluraUty of picture layers. 
15 The picture layer may include a picu«_start_code (PSC). a header dau including a 
plurality of coding parameters and a pluraUty of slice layers. He sUce layer may 
include a slice.stait.code (SSQ. header dau including a plurality of coding 
parameters and one or more macroblock layers. He macoblodc layer may include a 
plurality of coding param«e.s (macroblock.address.increment. macroblock mode. 
20 quan.i^er.scale_code. motion.vectors, coded.blocIcj,att«„) and DCT coefficients. 

When the variable length decoding secdon 21 parses the syntax of the source 
encoded stream, .he variable length decoding section can detect or notice a boundary 
of layers or a boundary of data elements in accordance with pt^detennined 
s.an_codes, such as SHC, GSC, PSC or SSC. which may be provided a. the start 
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posiUon of each layer. However, a predetermined start_code (such as SHC. GSC. 
PSC or SSC) may not be positioned at the start of each macroblock layer. 

The DCT coefficients in the encoded stream may not be variable-length- 
decoded (VLD) data having a predetermined data length, but may be a variable- 
length-encoded (VLQ code. Specifically, DCT coefficients in the encoded stream 
may have been subjected to a variable-length-encoded process based on a zero-run- 
length of the source DCT coefficients and a level (non-zero) of the source DCT 
coefficients in accordance with a DCT coefficients table in the MPEG encoder. 

Therefore, if one of the macroblocks includes a syntax error, the parsing 
process to obtain the VLC codes of the coding parameters may not only fail for the 
macroblock having the syntax error, but may also faU for the macroblocks located 
after the respective macroblock having the syntax error. 

Coding parameters for indicating a position of a macroblock in a picture will 
now be explained with reference to Fig. 4A and 4B. 

Fig.4A iUustrates a slice layer provided in a picture. The slice layer may 
include a first macroblock MBl, a second macroblock MB2. a third macroblock MB3, 
a fourth macroblock MB4, a fifth macroblock MBS, a sixth macroblock MB6, a 
seventh macroblock MB7, a eighth macroblock MBS, and a ninth macroblock MB9. 
The second macroblock MB2. the sixth macroblock MB6 and the seventh macroblock 
MB7 are so-called skipped-macroblocks. As such, the second macroblock MB2 may 
be assigned the same DCT coefficients as that of the first macroblock MBl, and the 
sixth and seventh macroblocks MB6, MB7 may be assigned the same DCT 
coefficients as that of the fifth macroblock MBS. Further, when the encoded stream is 
decoded by a MPEG decoder, the first macroblock MBl may be repeated once so as 



14 



.0 generate the second macroblock MB2, and u,e fifth mac^block MBS ma, be 
«p.«ed nvice so as .0 generate the s«U> and sevenU. macroblock, MB6 and MB7. 

Fig.4B muarates tt,e encoded stream of the slice layer of Fig 4A. In snch 
encod«l stream, .h. sldpped-macroblocks MB2. MB6 and MB7 are no. desaib«l 
5 Tl« header area Of the slice layer may include a plonUity of coding pa^neters 
regarding the sUce layer. For example, such coding parameters may mdude a 

"slice.verUcaljx^iUon" which indicates a vertical position of the slice layer in the 
picture image. 

He header are. of a m*w.block layer may include a plurality of coding 
parameter, (such as "macrobloclc.address.increm.nt") reg„ding the macrobloclc 
layer. If the respective macn>bIock is the top or firs. m««b,ock in a,e slice layer, fte 
n^croblock.address.incronen, indicates an absolute horizonul posiUon or ^Idress of 
U.. respective macroblock. On the other hand, if U,e .^pectivc mac^bloclc is not the 
top or first macroblock in the slice layer, the macroblock.address.mcemen. may 
indicate the difference between the absolute horizontel address of the rcspectiv. 
macroblock and the absolute horizontal address of the previous macroblock. 

Therefore, in the arrangement of Fig. 4, the sUce.verticaljK«i,i„n for the 
encoded stream is -3". Fmtirer, the mac,oblock.add,.ss.incr«nent of the first 
macroblock MBl is "2" which indicates the absolute horizontal position of the firs, 
n^croblock; a.e maaoblock.address.mcrement of the third macroblock MBS in the 
"coded stream is "2- which indicates 4e difference of the absolute horizontal 
"Mrcss of the first macroblock MBl and the absolute horizontel address of the Uurd 
macroblock MB3; U,e macroblock.address.increment of the toor^ macroblock MB4 
is -l- which indicates the difference of the absolute horizontel address of the third 
n^croblock MB3 and the absolute horizontel address of the f«.r* macroblock MB4- 
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the macroblock_address_increment of the fifth macroblock MBS is "1" which 
indicates the difference of the absolute horizontal address of the fourth macroblock 
MB4 and the absolute horizontal address of the fifth macroblock MBS; the 
macroblock_address_increment of the eighth macroblock MBS is "3" which indicates 
the difference of the absolute horizontal address of the fifth macroblock MBS and the 
absolute horizontal address of the eighth macroblock MBS; and the 
acroblock_address_increment of the ninth macroblock MB9 is "1" which indicates the 
difference of the absolute horizontal address of the eighth macroblock MBS and the 
absolute horizontal address of the ninth macroblock MB9. 

Thus, the position of each macroblock can be obtained by referring to the 
slice_vertical_position described in the header area of the slice layer of the encoded 
stream and the macn)block_address_increment described in the header area of the 
macroblock layer of the encoded stream. Further, the total number of macroblocks in 
the slice layer can be obtained from the difference between the horizontal position of 
the top or first macroblock in a respective slice layer and the horizontal position of the 
top or first macroblock in the next slice layer. Furthermore, the number of the 
macroblocks which could not be decoded due to a syntax error can be obtained by 
subtracting the number of correctly decoded macroblodcs from the total number of 
macroblocks in a respective layer. 

The stream processing for correcting a syntax error performed in the variable- 
length decoding section 21 will now be described. 

If a syntax error occurs in the fifth macroblock MBS as shown in Fig. 5A, it 
may not be possible to variable-length-decode the macroblock MBS and to variable- 
length-decode from the sixth macroblock MB6 to the ninth macroblock MB9. Since 
the slice_start_code of each slice layer may be a predetermined fixed code, the 
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sUc..s,3r,_cod« Of . subscuen. ^Bc. hy« ^ *^ed .garCess of .he previous 
ooamence of a syneax e„or. ■n.e«ibr.. if a syntax enor occun in U.e fiftt 
ma«,block MBS of a respective sUce layer. aU niacroblocks (MBr. MB2'. 
MB3'. .... ) incloded io U,. „e« sli« layer can be variable-IengUwlecoded.' 

If a syntax «ror occurs in one o^croblock of a respective slice layer, the total 
number o, n«:oblo* inCuded in the respective sUce layer n„y no. be d«e„nined 
by referring only u, the coding parameters included in U« respective sUce layer 
Specificaay. U« total number of macoblocks in a tespective sU„ layer may be 
determined by subtracting the horizontal address of the top or macroblock of U,e 
> respective mac^blodc 6om the horizont^ address of the top or firs, macroblock of 
me n«„ macroblocic Tie number o, mact^blocks which can not be decoded due to a 
syntax etror be detennined by subtr^ting the number of decoded macroblocks 
ftom the total number of macroblocks in the respective layer. 

As an example of flte above, and with reference to Fig. 5A. if the horizontal 
address of the first macroblock MBl of a respective sUc. layer is "3-. and the 
horizontal addtess of the first macroblock MBr of the next slice Uyer is '12' U,e 

.OUI number ofmacroblocts in the respe«ives>icelay.ris.9-(=12.3). Further if 
-e four macroblocks torn the firs, mac^block MBl u> «.e fourth macroblock MB4 
had be«, decoded correcUy. the number of macroblocks which could not be decoded 



is "5' 
( = 9-4). 



In the presem st«am processing, predetermined mactoblocks which confonn 
.0 a MPEG syntax may be substituted fbr the mactoWocks which may not be cotrecUy 
d«oded due to a syntax enor. Such predetennined mactoblocks may include a bUck 
n-roblock (whose luminance sign,, is OxlO and whose color-diffe^ce si^ is 
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0x80), a gray macroblock (whose luminance signal and color-difference signal are 
both 0x80), which has a minimum amount of generation bits, or a flat-pattern 
macroblock. 

Figs. 5 to 9 illustrate methods for substituting macroblocks which may not be 
able to be parsed variable-length-decoded correctly due to a syntax error with 
predetermined macroblocks having a correct syntax. For example, when a syntax 
error occurs in the fifth macroblock MBS as shown in Fig. 5A. the fifth macroblock 
MBS to the last macroblock MB9 may be replaced with predetermined macroblocks 
having a correct syntax as shown in Fig. SB. Alternatively, as shown in Fig. SC, the 
fifth macroblock MBS to the eighth macroblock MBS may be assigned or designated 
as skipped macroblocks and the last macroblock MB9 may be replaced with a 
predetermined macroblock having a coixect syntax. As another alternative, and as 
shown in Fig. 5D, the fifth macroblock MBS and the last macroblocks MB9 may be 
replaced with predetermined macroblocks having a correct syntax and the sixth 
macroblock MB6 to the eighth macroblock MBS may be assigned or designated as 
skipped macroblocks. As yet another alternative, and as shown in Fig. SE, the first 
macroblock MB to the ninth macroblock MB9 may be replaced with predetermined 
macroblocks having a correct syntax. Further, and as shown in Fig. SF, the first 
macroblock MBl and the last macroblock MB9 may be replaced with predetermined 
macroblocks having a correct syntax and the second macroblock MB2 to the eighth 
macroblock MBS may be assigned or designated as skipped macroblocks. 

As shown in Figs. 6A and 6B, if a syntax error occurs in the header area of a 
slice layer, all data elements of the sUce layer may be replaced with a predetermined 
slice layer comprising a plurality of data elements having a correct MPEG syntax. As 
shown in Figs. 7 A and 7B, if a syntax error occurs in the header area of a picture layer. 



18 



aU dau el™«B Of U„ picto. layer »«y be ,eplac«l wiU. , predetennined picmre 
hyer comprising a plurality of dau elements having a conect MPEG sy,«ax. As 
shown in Figs. 8A and 8B. if a syn... enor occnrs in the header area of a GOP layer, 
aU data elements of U>e GOP layer may be replaced with a predetennined GOP layer 
S "-"P*ingapln,aU,yofd«a.lemen.shavingac»,re«MPEGsynta.. Asshownin 
Figs. 9A and 9B. if a syntax error occurs in the header ar«. of a sequence layer, the 
sequence layer may be replac«l with a pr«letennined sequence layer oomptising a 
pluraUty of data events having a correct MPEG syntax. Alten^tively. as shown in 
Fig. 9C, the sequence.header.code (SHQ provid«J in the start position of the 
10 sequence layer having the syntax enormay be replaced with a sequence_end_code 
(SEQ indicating an end of the video sequence. 

Fig. 10 iltosttates a>e vadable-length decoding section 21 for perfbnning the 
present stream preceding wherein an encoded stream having a syntax enor is 

r.pIaced.maccordancewith«. embodiment oftheptesentinvention. Asshown 
.5 th^in, the variable-length decoding secdon 21 may mdude a variable-length 
decoding circuit 61. a memory 62. a sub«itution control circuit 63. a maeroblock 
(MB) coefficient generation circuit 64, and a switch 65. 

Tic variable-length decoding circuit 61 parses the syntax of the source 
«.cod«. stream, and detects or determines whether or no, a syntax error has occurred 

20 "a^'O'-ce.ncodedstreaminaca^rdancewitharesultoftheparsingprocess. 
Further, the variable-lengOr decoding circuit 61 extracts variable-length encoded 

codes indicating the coding parameters from the source encoded stream based 
on the parsing process. If a prohibitive VLC code, an undefined VIC code, a 
contradiction VIT code, or a parsing impossibility VIC code are detect«i in the 
2S source encoded stream by the parsing process, the variable-length decoding circuit 61 
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... ..... A 1^ 

PATENT 
450100-4832 

generates enor infonnation indicating that the source encoded stream includes a 
syntax error, and supplies the error infonnation to the substitution control circuit 63. 
Furthermore, variable-length decoding circuit 61 performs a variable length decoding 
process on the extracted variable-length encoded codes to generate variable length 
5 decoded (VLD) data indicating coding parameters. The variable-length decoding 
circuit 61 analyses the VLD data of the coding parameters to detect a contradiction 
coding parameter or a coding parameter not defined in the MPEG standard or the like. 
If a contradiction coding parameter or an undefined coding parameter or the like is 
detected in the source encoded stream by the analyzing process, the variable-length 
10 decoding circuit 61 generates error information indicating that the source encoded 
stream includes a syntax error, and supplies the error information to the substitution 
control circuit 63. The variable-length decoding circuit 61 may also output various 
coding parameters which may have been obtained in the variable-length decoding 
process to the substitution control circuit 63. 
15 The substitution control circuit 63 calculates the macroblock addresses of the 

macroblocks based on tiie respective sUce_vertical jjosition and the 
macroblock_address_increment supplied from the variable-length decoding circuit 61 
as the various coding parameters. Further, tiie substitution control circuit 63 
calculates the total number of macroblocks in a respective slice layer by subtracting 
20 the macroblock address of the top or first macroblock in the respective slice layer 
from the macroblock address of the top or first macroblock in tiie next slice layer. 
AdditionaUy, the substitution control circuit 63 may determine which macroblock has 
a syntax error by use of the error information supplied from tiie variable-length 
decoding circuit 61 and, as a result, tiie substitution control circuit 63 can calculate tiie 
25 number of macroblocks which may not be parsed or variable-lengtii-decoded correctiy 
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due to the syntax error in accordance with the number of macroblocks which have 
been variable-length-decoded and the total number of macroblocks in the respective 
slice layer. n,e macroblocks which may not be parsed or variable-Iength-decoded 
correctly are the macroblocks to be replaced by the substitution process performed by 
5 the substitution control circuit 63. Furthermore, the substitution control circuit 63 
controls the macroblock coefficient generation circuit 64 and the switch 65 in 
accordance with a result(s) of the calculation(s) performed therein. 

The macroblock coefficient generation circuit 64 generates new macroblock 
data having a correct syntax. Specifically, the macroblock coefficiem generation 
10 circuit 64 may have a memory circuit 66 having various predetermined DCT 

coefficients stored therein to generate various kinds of new macroblocks. Such DCT 
coefficients may not be VLC code, but may be VLD data. As an example, when a 
macroblock having a black color is generated, the macroblock coefficient generation 
circuit 64 generates coefficients having a value "0x10" for DCT coefficients of a 
15 luminance signal and generates coefficients having a value "0x80" for DCT 

coefficients of a color-difference signal. As another example, when a macroblock 
having a gray color is generated. Uie macroblock coefficient generation circuit 64 
generates coefficients having a value "0x80" for DCT coefficients of a luminance 
signal and generates coefficients having a value "0x80" for DCT coefficients of a 
20 color-difference signal. When an any-pattem macroblock is generated, flat patterns 
formed of only DC components are generated as intra-macroblocks which do not 
receive the effects of the preceding and subsequent macroblocks. 

The switch 65 switches to the appropriate one of the source encoded stream 
from the memory 62 and the DCT coefficient stream generated by the macroblock 
25 coefficient generation circuit 64 in response to a control signal from the substitution 
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control circuit 63, such that the respective macroblock having a syntax error and the 
macroblocks which follow and/or which precede may be replaced with a new 
predetermined stream having a correct syntax. 

Fig. 11 illustrates another embodiment of the present variable-length-decoding 

S section for performing the stream processing to replace the source encoded stream 
having a syntax error. The variable-decoding section 21' may include the variable- 
length decoding circuit 61, a memory 72, the substitution control circuit 63, a 
macroblock VLC code generation circuit 74, and the switch 65. The configurations 
and functions of the variable-length decoding circuit 61, the substitution control 

10 circuit 63, and the switch 65 may be similar to those of the decoding section 21 shown 
in Fig. 10. 

In the variable-length-decoding circuit 21', the memory 72 does not store a 
VLD data stream obtained from the variable-length-decoding process, but instead 
stores the source encoded stream having VLC codes which may be obtained prior to 

15 the variable-length-encoding process. 

The macroblock VLC code generation circuit 74 generates the VLC code to 
be used as a substitution or replacement for the source encoded stream output firom 
the memory 72. Specifically, the macroblock VLC code generation circuit 74 may 
have a memory 73 for storing predetermined information such as macroblock data 

20 having VLC codes indicating a black color or a gray color, P-picture macroblock data 
having VLC codes indicating simple interframe prediction, B-picture macroblock data 
having VLC codes indicating the same prediction direction and a motion vector(s) of 
a previous macroblock. The macroblock VLC code generation circuit 74 outputs the 
predetermined macroblock data having VLC codes in accordance with a control signal 

25 supplied from the substitution control circuit 63. 
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ITc switch 65 switehc «. the approprf^. ^ ,t ^IC »de stream of the 
source encoded strean, supplied ftorn the n,«nor, 72 the VLC code ^ream 
u-dicati-g the DCr c„efficie.t(s) generated by the tnacroMock VLC cod. generation 
cucuit 74 in respond to a con.ro, signal ftom the substitution control circuit 63. such 
5 0^ the .acoblock which not be parsed or variable-length^coded corxecUy 
due to a syntax error and/or U,e n«croblocic(s) which precede or succeed thereflon, 
may be substituted or replaced with a p^tem^ strean. having a correct syntax. 

Since the above^escribed stream processing performs variable-length 
encoding and variable-length decoding and does no. perfonn quantization and inverse 
.0 t^d^uon. dre quauty of the image obtained therefrom may not be adversely 



affected • 



T1.US. according to U» stream pnxessing apparatus of the present invention 
since a macroblock having a synrax error in the source encoded s.ream is replace. 
With a new macrobiock having a correct synuu. accepuble s.r«m, processing may be 
15 -*«^''regardlessofthesyntaxe,x„rin.hesourceparsingprocess. 

TO ferther explain the proc«si„g o, d,e conversion section 22. an example of 
a MPEG stream and a SX stream wiU now be described below with refer^tce to Figs 



12 to 16. 



Fig. 12 iUustn-tts a hierarchical strucnire of a MPEG standard. s«* as 
^ U» 4:2:2P@ML (4:2:2 profae@main level) standard of MPEG 2. 

AS Shown m Fig. 12A. a sequence layer may include a number of sets each 
i-ving a sequence header code (SHC: sequence.header.code, a header section, an 
extension section, and a number of GOPs (groups of pictures). At the end of the sets 
or sequence, a sequence end code (SEC: sequence.end.code) may be disposed 
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As shown in a GOP layer of Fig. 12(B). a GOP from Fig. 12A may include a 
group start code (GSC: group_start_code) at the top. a header section, an extension 
section, and a number of pictures. A picture can be an intra-frame encoded image (I 
picture: intra picture), a forward predictive encoded image (P picture: predictive 
5 picture), or a bidirectionally predictive encoded image (B picture: bidirectionally 
predictive picture). These I. P. and B pictures may be disposed in a predetemained 
order to form a GOP. 

As shown in a picture layer of Fig. 12(C). a picture from Fig. 12B may include 
a picture start code (PSC: picture_start_code). a header section, an extension user 
10 data section, and a number of slices. 

As shown in a slice layer of Fig. 12(D). a sUce of Fig. 12C may include a slice 
start code (SSC: slice_start_code), header section, and a number of macroblocks 
(MB: macroblock). 

As shown in a MB (macroblock) layer of Fig. 12(E). a macroblock MB of Fig. 

15 12D may include an address, a mode, a quantizer scale code (qsc: 

quantizer.scale.code). a motion vector (mv: motion.vector), a code block pattern 
(cbp: coded_block_pattem), and a predetermined number of blocks. A block may be 
formed of eight by eight DCT coefBcients obtained by applying DCT (discrete cosine 
transforai) to a DCT block of eight by eight pixels. In 4:2:2profile@main level, one 

20 macroblock MB may be formed of eight DOT blocks, that is. four luminance-signal 
blocks YO. Yl. Y2, and Y3. and two types of two color-difference-signal blocks CbO 
and Cbl, and CrO and Crl. 

The eight by eight DCT coefficients in one DCT block may be arranged such 
that a DC component is disposed at the upper left comer and AC components are 
25 disposed in an order from a low spatial frequency to a high spatial frequency, in the 
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direction from the upper left to the lower right. A so-caUed zigzag scanning methoo 
may be utilized in which the DCT coefficients in this block are taken out in a 
predetennined order and variable length coding is appKed. In addition to zigzag 
scanning, a so-cafled alternate scanning method may be utilized. Either zigzag 
5 scanning or alternate scamiing can be switched and used in units of pictures. The 
alternate scamiing method is suited for encoding of an interlaced image since 
interlaced components can be efficientiy taken out. 

Fig. 12(F) iUustiates an encoded data string obtained by applying variable- 
length or entropy encoding (such as Huffinan coding) to a one-dimensional DCT 
10 coeffidentstringobtainedforeachDCTblock. Encoded data may be represented by 
rAC-lfyO] and so forth as shown in Fig. 12(F). In variable length encoding, a code 
rAC- may be determined by a zero-nm length and a no-zero level. 

nie SX stream corresponding to the above MPEG stream may have a 
hierarchical structure as shown in Fig. 13. 

15 In the format shown in Fig. 13. one GOP in a GOP string of a sequence layer 

Shown in Fig. 13(A) may include two frames, that is. an I picture and a B picture as 
Shown inaGOPIayerofFig. 13(B). TTiis structure may correspond to a SX stream 
for use with a video tape recorder. Tbc SX stream itself may have a GOP with up to 
30 frames, including I. P. and B pictures. When the SX stream is used with a video 
20 tape recorder, stuffing may be performed so to perform a recording operation on a 
tape with a GOP having a constant length. 

A picture layer shown in Fig. 13(C) and a sUce layer shown in Fig. 13(D) may 
conform somewhat to the MPEG standard described with reference to Fig. 12, as well 
as the sequence layer shown in Fig. 13(A) and the GOP layer shown in Fig. 13(B). 
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Since such layers may not have header information, various types of header 
information may be added to the Sx stream when it is converted to a MPEG stream. 

The order in which DCT coefBcients are arranged in a macroblock MB layer, 
such as that shown in Fig. 13(F), may be different from that of the MPEG foraiat 

5 shown in Fig. 12(F). That is, as shown in the encoded data of Fig. 13(F), the DC 
components of the eight DCT blocks YO to Crl may be respectively arranged first, 
and then the AC components of the DCT coefficients corresponding to frequencies in 
the DCT blocks may be sequentially arranged in units of eight coefficients from a low 
spatial frequency to a high spatial frequency. As a result, in the macroblock MB, DC 

10 components and low spatial frequency AC components, which may be important in 
image reproduction, are closely arranged.. 

Advantages of the above-described arrangement of DCT coefficients will be 
described below with reference to Figs, 14A and 14B and Figs. 15A and 15B. 

When the MPEG stream and the SX stream described above are recorded in 

15 slanted helical tracks on a video tape with the use of a rotating head and reproduced at 
a relatively high speed, since the slanted angle of a head trace may differ from the 
slanted angle of the helical tracks (which serve as recording tracks), only a part of the 
data on the helical tracks may be reproduced. Even if error correction is applied, only 
a part of a macroblock MB may be effectively reproduced and the remainder may not 

20 be reproduced and, as such, may be considered as an error. 

Figs. 14A and 14B illustrate a situation in which data recorded on a video tape 
with MPEG2 format (described above as an example of the MPEG stream) is 
reproduced at a relatively high speed. Hatched portions indicate error areas wherein 
correction may not be possible. Fig. 14A illustrates a one-dimensional arrangement 

25 of DCT coefficients of the encoded data in a macroblock. Fig. 14B illustrates a two- 
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d.n,«sio„al o, ^ OCT coeffici«,« „b,au,^ by decoding u,e encoded 

^ in Which U,e horizonu, indicates .he ^ f^,^ ^ ^ 
indices U-e DCTblock. In .he ex,n.ple show, in Fig. 14B. .ince DCT blocks 
YO. Yl. Y2. »d Y3 Of U„ ,„..-^ce signals Y n.y be effecdveiy .p^nc«, and 
5 U,e DCr blocks CbO. 00. Cbl. and Crl o,*e color^c. signal be 
considers, enoneous or may no, be effectively reproduced, video wiu»„, color 
components ma, be obtained. If U.e a,lor^„en« signal CbO is effecUvely 
reprodoc«l . an unusual color may be obtained . When the luminance signal Y3 
becomes etroneous. a pan of the DCT blocks in the macroblock becomes l«*ing 
10 Such rq,roduced image is unsightly and not preferred. 

On the other hand, when dau recorded on a video tape with the SX stream is 
""^^ « ' «»Uvely high speed, a hatched po«ion in a one^mensional 
•-nsement shown in Hg. 15A may be considers, enoneous or may not be 
effeoively reproduced. As shown m Fig. ISB, DC components and low.fte<,uency 
" ACcomponents important for image reproduction may be effectively ,.pr«taced for 
>!. DCr blocks in the macroblock. As a result, a «rly accepubl. reproduced image 



may be obtained. 



<n high-speed reptoducUon. an error may occur a. a difieren. position in each 
-croblock. If DC components and low-frequency AC components are not 
0 effectively obtained in a macroblock. an effective image fbr a previous ftame may be 
displayed instead of using the data of ^, macrobloC TTe displayed image may be 
P««a„y updated in units of tnacrob.ocks. and may not provide an unacceptable image 



to a viewer. 



In the SX stt^m. the zigzag scanning and the alternate scanning, can be 
switched in units of macroblocks so as to improve image ,u.ity. Specifically, it may 
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be advantageous to use frame DCT and zigzag scanning in combination for a frame 
image (sequentially scanned image) having a small motion, and to use field DCT and 
alternate scanning in combination for an interlaced image having a large motion. In 
the SX stream, by enabling these combinations to be switched in units of macroblocks, 
more precise adjustment may be performed and image quality may be improved. 

On the other hand, in the MPEG stream, only one scanning type may be used 
in a picture as described above. In other words, the DCT type may be switched 
between field DCT and frame DCT in units of macroblocks, but the scanning type 
may not be changed in units of macroblocks. 

When the scanning type is switched in units of macroblocks in the SX stream, 
the conversion section 22 may re-anrange DCT coefficients so that the scanning type 
used in a picture matches that of the MPEG stream. 

Processing for converting the SX stream to the MPEG stream will now be 
described with reference to Figs. 16A to 16D. 

Fig. 16A illustrates a one-dimensional arrangement of encoded data of DCT 
coefficients of a macroblock in an encoded SX data stream. The conversion section 
22 may detect the first encoded data DC[ YO] in this macroblock to make data 
delimitation clear. The encoded data may be written into a memory of the conversion 
section 22 in the order indicated by the arrows in Fig. 16B from the first encoded data 
DC[YO]. Fig. 16B shows that, for example, encoded AC coefficient data AC-2 and 
AC-3 may be at the same time stored in the memory when a DCT block including the 
coefficient AC-2 and a DCT block including the coefficient AC-3 are derived by 
tracing the helical track. The coefficient data stored in the memory of the conversion 
section 22 may be converted to the order of the MPEG stream by reading DC 
components and AC components in the order from a low spatial frequency to a high 
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spatial ftcqucncy (such as shown in Fig. 16C) in „ch DCT block. When fte scaling 
W. (zigzag scanning or alternate scanning) is switched in units of tnacroblccks in the 
SX stteatn. Ute DCT coefficients .nay b. ™ged so U«, the scanning type used in 

.pictn,ema.chestb..of,heMPEOs.r«». Such processing n>ay cotrespond to that 
J performed in the conveision section 22. 

Next, a bit-nue conversion processing of the conversion section 22 wiU be 
describe, below by referring .0 a flowchart shown in Fig. 17. Uns preceding starts 
when the variable-length decoding section 21 inputs the video stream smu to the 

conversion section 22. 

10 In a step SI. the conversion section 22 detemUne, whether the variable-length 

<tecoding secuon 21 has input the source stream. When it is determined that the 
s«aminput.inghasb.e.finish.d.theproc«singisfinished. When it is determined 
that the stream inputUng has not been fimshed. the processing proceeds to a step S2. 
to the step S2, the conversion section 22 initirfizes a parameter N (N ranges tan 0 to 
15 «3) indicating the position of a DCT coefflcien. torn the highest-order DCT 
coefiBcient, to zero. 

In a step S3, the convention s«:tion 22 changes N non-zero coefficients ftom 
the highest-order DCT coefficient to ze» and outputs to the variable-length en»ding 
secuon 23. He variable-length encoding secUon 23 appUes variable-length encoding 
20 to a portion where varlaHe-Iength encoding has not been app,i«, m the input stream 
atK. outputs to the header addiUon section 24. The header addition section 24 adds 
header infom«tion prepared in advance to the input stream and outputs to the stuffing 
section 25, 

to > step S4, the smffing section 25 detemrines whed,er the bit rate of the 
- stream Smi4 input from the header addition section 24 is no. larger U»n the bit rate 
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specified in advance. When the bit rate of the input stream is larger (exceeds) the bit 
rate specified in advance, the processing proceeds to a step S5. In the step S5, the 
stuffing section 25 sets the control signal CUT to "1" and outputs it to the conversion 
section 22. Corresponding to this control signal CUT, the conversion section 22 
increments the parameter N by 1 and the processing returns to the step S3. 

Until it is determined in the step S4 that the bit rate of the stream STRM4 
input to the stuffing section 25 is not larger than the bit rate specified in advance, the 
processes from the step S3 to the step S5 are repeated. When it is deteraiined in the 
step S4 that the bit rate of the stream output to the stuffing section 25 is not larger 
than the bit rate specified in advance, the processing proceeds to a step S6. 

In the step S6, the conversion section 22 decrements the parameter N by 1 
according to control of the system controller interface 26, and the processing returns 
to the step S3. 

In a step S7, the stuffing section 25 inserts a stuffing bit of "0" into the stream 
STRM4 until the bit rate of the input stream STRM4 reaches the bit rate specified in 
advance. Details of the stuffing processing wiU be described later by referring to Fig. 
18. 

The stuffing processing in the stuffing section 25 will be described next. Fig. 
18 shows a detailed structure of the smffing section 25. The bit stream 
(corresponding to the output stream STRM4 shown in Fig. 2) input to the stuffing 
section 25 (Fig. 2) is sent to a timing generator 51, a bit-rate counter 52, and a delay 
section (DL) 57. 

The timing generator 51 detects a V-Blanking signal (corresponding to a 
signal indicating a vertical blanking period in each field of a usual video signal) in 
each frame, which is included in a bit stream and which indicates a period in whidi 
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effective data does not exist in the bit stream as shown in Fig. 19, n.e Uming 
generator 51 generates a GOP.START signal in synchronization with the timing 
when the V-Blanking signal is released (when effective data appears), and outputs it 
to the bit-rate counter 52. Il»e bit-rate counter 52 resets its counter in synchronization 
5 with the GOP.START signal, counts the amount of effective codes included in the bit 
stream, and outputs the count to a comparator section 53. 

me timing generator 51 generates a GOP.END signal in synchronization with 
the timing when a V-Blanking signal is again generated (when effective data 
disappears), and outputs it to the comparator section 53 (it is assumed that one GOP 
[) corresponds to one picture). 

The comparator section 53 compares the count indicating Uie amount of 
effective codes input ftom the bit-rate counter 52 with a bit rate Target_bit_xate 
specified in advance in a CPU interface (CPU.IF) 54 (corresponding to the system 
control section 26 shown in Fig. 2), in synchronization with the timing when U:e 
GOP.END signal is input When the count is less than the bit rate Target.bit.rate, 
the comparator section 53 outputs a signal Stuffing.value indicating the diffe^nce^ 
therebetween to a stufBng counter 55. 

■n.e sniffing counter 55 «ecntes eoonting opaatioas (Bme-measuring 
operaUons) by 4c value of U,c inpu. diff««,« signal Stuffing^value. and output a 
Signal Sn.ffin6..„abl. «> a switch 56 during tt« counUng operaUons. The switch 56 
receives the bi. stream «, which the delay corresponding to the ptocesses ftom the 
timing generator 51 to the stuffing counter 55 is appUed and stuffing bits of -O" ftom 
ttie delay section 57. The switch 56 s«.& the bit stream with bits of "O" while it is 
receiving the Stu£Bng_enable signal. 
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On the other hand, when the comparator section 53 detennines that the count 
is larger than the Target_bit_rate bit rate, the comparator secUon 53 sets the control 
signal CUT to "1" and outputs it to the conversion section 22 (Hg. 2). As described 
above, the conversion section 22 changes higher-order non-zero coefficients of the 
DCT coeffidents to zero corresponding to this control signal CUT. 

As described above, in the present embodiment, since stuffing is performed in 
a period when a V-Blanking signal included in a video signal exists, packing is 
unnecessary. Therefore, a memory for packing is unnecessary. In addition, since 
packing is not performed, a system delay can be set to the minimum (rcal-time 
processing can be performed). 

Next, a start-code-emulation preventing processing in the stream conversion 
sections 5, 15 will be described. This processing is executed mainly by the header 
addition section 24. As described above, the stream conversion sections 5, 15 
executes the processing for converting the structure of the source encoded stream. 
Since information unique to the SX stream, such as video editing information, is not 
specified in the general MPEG stream, the unique information is described in the user 
data field in the general MPEG stream. The user data field in the MPEG stream does 
not have any special rule (free format) unlike the other data fields in the MPEG 
stream. Any information can be described therein, but start-code emulaUon may 
occur. 

Start-code emulaUon will be described below. In the general encoded stream, 
as a special data pattern indicating the top of each data field, a combination of 
successive 23 bits of "0" and the following one bit of "1" is specified as the start code. 
In the data fields other than the user field, successive 23 bits of "0" is not allowed 
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««p, for U« .op Of c«* D.,d. Since any dau c« be wri««, in.o U,c „«r dau field, 
.he user needs to consciously write dau witt,„„, sped^g successive 23 biB of "0." 

Starts emulation refers «, a case in which data specified in a,e user data 
field accidentally matches d.e star, code. TOs case causes a fittal error which has a 
5 high possibility of image destruction. 

In the present «nbodiment. the header addition section 24 inserts marker bie> 
Of "1" a, every 16 bits in the user data field to prevent start^code emulation as shown 
in Fig. 20. 

Hg. 21 shows a detailed strucmie of a portion that executes start^code- 
10 emulation preventing processing in U« header addition section 24. Fig. 22 shows 
operation "toing » «ach part A buffer 41 s«res user dau to be written into U>e user 
data field, and sends user data in «tits of 16 bits to a register 45 in synchronization 
wiU. a cock signal as Shown in Rg. 22. Herefore. U,. buffer 41 needs to have a 
capacity larger than U.e value obtained by (U,e maximum user data lengtiiAS). 
« A bit-shift measur«nem section 42 is formed of a four-bi. counter 43 which is 

reset in synchronization wiu, a user data start axle (0x000001B2) and an adder 44 tor 
i^reasing the count by 1. and outputs a control signal "ct- to a data selection section 
47. TV register 45 stores 16-bit userdatasent ftom ti» buffer 41, and outputs U» 
stored user da« "regl - to a register 46 and .he data selection section 47 in 
» synch«,nizationwiti,U»clock. !!« register 46 stores 16*it user data input ftom U.e 
register 45 «,d outputs tite stored user data "r.g2" (which is ti>e same user data as 
"regl ■ existing one clock cycle before) to Uie data selection section 47. 

He dau selection section 47 selects predetetmined 15 bits among the user 
dau 32 bit wide fotmed of U,e user dau "regl ■ input from 0. register 45 and «,e user 
' dau "regZ" inpu. fiom U« register 46. according to Ute value of ti,e control signal "c." 
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sent from the bit*shift measiirement section 42, and outputs them. As shown by a 
one-dot chain line in Fig. 22, for example, when the value of the control signal "ct" is 
three, the data selection section 47 selects 15-bit user data d3[4] to d2[2] among 32-bit 
user data d3[l] to d2[16]. When the value of the control signal "ct" is four (at the next 
clock cycle), the data selection section 47 selects user data d4[5] to d3[3], A marker- 
bit generating section 48 outputs a marker bit of "1" after the data selection section 47 
outputs 15-bit user data. 

Since a marker bit is inserted at the output as described above, the output rate 
is lower than the input rate at the buffer 41, In other words, only 15-word input data 
is processed (output) in 16 clock cycles. Therefore, the buffer 41 is controlled such 
that it stops sending user data to the register 45 once in 16 clock cycles (when the 
control signal "ct" is 14 in the example shown in Fig. 22. 

In the present embodiment, the ratio of marker bits in user data iis 6.25 (= 
1/16)%, As compared with a case in which marker bits are inserted every 23 bits 
(4.35 (= 1/23)%), the transmission efficiency of user data is reduced by 1.9%. Since 
the ratio of the user data field in the entire video signal is one-several-hundredth, 
however, it can be said that reduction in the transmission efficiency is sufficiently 
suppressed (the transmission efficiency is not much reduced) for the entire stream of a 
video signal. 

Although preferred embodiments of the present invention and modifications 
thereof have been described in detail herein, it is to be understood that this invention 
is not Limited to these embodiments and modifications, and that other modifications 
and variations may be effected by one skilled in the art without departing from the 
scope of the invention as defined by the appended claims. 
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CLAIMS 

1. A stream processing apparatus comprising: 

parsing means for parsing a syntax of a source encoded stream to extract a plurality 
of coding parameters &om said source encoded stream; 

detecting means for detecting an error macroblodc having a S3^tax error in said 

parsing process performed by said 



source encoded stream in accordance with a result of a 



panmg means; 

variable-length-decoding means for performing a variable-length-decoding 
on said source encoded stream to generate a variable-length-decoded stream; 

generating means for generating a predetemdned macroblodc having 
syntax which confonns to a motion picture image coding 
and 



process 

a correct ,>^4.j.. 
experts group (MPEG) standard; 



2- He «^ pK««i„g ^ j_ ^ ^^^^ 

means conTob said „ *a. said p«fc«™i„^ ^ ^ 

for a substimaon period fto™ said ^aobtock » an «^ 
respective sUa layer having said etior maooblocfc. 

3. TTe stream processing appa«.us acceding daim 2. wherein said substituting 
means caicuiates maooblock addresses of said «„,r n^croblock. a firs. n«crobloc. of said 
respective sBce Uyer and a „acrobIock of a subsequ^,. slice layer, and whetein said 
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substituting means decides said substitution period based on said macroblode addresses of 
said error macroblock, said first macroblock of said respective slice layer and said first 
nxacroblock of said subsequent slice layer. 

4. The stream processing apparatus according claim 3, wherein said substituting 
means calculates a macroblock address of a respective macroblock from a 
slice_yertical_position indicating a vertical position of a corresponding slice layer having 
said respective macroblock and a macroblock_address_increment indicating a horizontal 
position of said respective macroblock, and wherein said slice_verticaljposition and said 
macroblock_address_increment are extracted from said source encoded stream by said 
parsing process. 

5. The stream processing apparatus according claim 4, wherein said 
slice_vertical_position is described in a header position of said corresponding slice layer of 
said source encoded stream and said macroblock_address_increment is described in a 
header position of a macroblock layer of said source encoded stream. 

6. The stream processing apparatus according claim 5, wherein said parsing means 
extracts the macroblock_address_increment of said first macroblock of said subsequent slice 
layer by detecting a slice_start_code of a predetermined code. 

7. The stre-Ti processing apparatus according claim 2, wherein said substituting 
means calculates a macroblock address of a first macroblock of said respective slice layer 
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»d . macroblock address o£ a to, macroblock of a suteequen. sU« Uyer based on said 

coding paramettB, aiKl whereto said coding p,«m««s are suppUed fiom said ^ 
means and toci^J. a slice.verticalj«sition todicadng a vertical posiUon of said respecSve 
sUce lajrer and a «»croblodc_«id,.ssJncremen. todicating a horizontal position of said first 
macroblocks. 

8. TTie stream processing apparatus according claim 7. wherein said substituting 
means calculates a number of macroblocks whidi could not be pareed due to said sj^tax 
error based on said macroblock address of the first macroblock of said respective sUce layer 

and said macroblock address of the first maooblock of said subsequent SUce layer an^ 
accordance therewith, said substituting means controls a substituti^^ 
said predetermined macroblock into said variable-length-decoded stream. 

9. A stream processing method comprising the steps of: 

parsing a syntax of a source encoded stream to extract a plurality of coding 
parameters fiom said source encoded stream; 

detecting an error macroblock havingasyntax error in said souice encoded st^ 
accordance with a result of a parsing process; 

performing a variable-length-decoding process on said source encoded stream to 
generate a variable-length-decoded stream; 

generating a predetermined macroblock having a correct syntax which conforms to a 
motion picture image coding experts group (MPEG) standard; and 
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substituting said predetennined macroblock for said error macroblock of said 
variable-length-decoded stream. 

10- The stream processing method according claim 9, wherein the substituting and 
generating steps are controlled such Aat said predetermined macroblock will be substituted 
for a substitution period from said error macroblock to an end macroblock of a respective 
slice layer having said error macroblock. 

11. The stream processing method according claim 10, wherein the substituting step 
calculates macroblock addresses of said error macroblock, a first macroblock of said 
respective slice layer and a first macroblock of a subsequent slice layer, and wherein the 
substituting step decides said substitution period based on said macroblock addresses of said 
error macroblock, said first macroblock of said respective slice layer and said first 
macroblodk of said subsequent slice layer. 

12. The stream processing method according claim 11, wherein the substituting step 
calculates a macroblock address of a respective macroblock from a slice_vertical_position 
indicating a vertical position of a corresponding slice layer having said respective 
macroblock and a macroblock_address_increment indicating a horizontal position of said 
respective macroblock, and wherein said slice_vcrtical_position and said 
macroblock_address_increment are extracted fi^om said source encoded stream by said 
parsing process. 
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13. The stream processing method according claim 12. wherein said 
sbce.vertical j,osiUon is described in a header position of said correspcmding slice layer of 
said source encoded stream and said macroblock.address.increment is described in a 
header position of a macroblock layer of said source encoded stream. 

14. n,e stream processing method according claim 13, wherein the parsing step 
extracts the macroblock.address.increment of said first macroblock of said subsequent slice 
layer by detecting a slice_start_code of a predetermined code. 

15. The stream processing method according claim 10, wherein the substimting step 
calculates a macroblock address of a first macroblock of said respective slice layer and a 
macroblock address of a first macroblock of a subsequent slice layer based on said coding 
parameters, and wherein said coding parameters are supplied fiom the parsing step and 
include a sh'ce.vertical jK)sition indicating a vertical position of said respective slice layer 
and a macroblock.address_increment indicating a horizontal position of said first 
macroblocks. 

I 

16. TT,e stream processing method according claim 15, wherein the substimting step 
calculates a number of macroblocks which could not be parsed due to said syntax error 
based on said macroblock address of the first macroblock of said respective slice layer and 
said macroblock address of U.e first macroblock of said subsequent slice layer and. in 

accordance therewith, the substituting step controls a substitution timing for switchm^ 
predetermined macroblock into said variable-lengtii-decoded stream. 
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17. A stream processing apparatus comprising: 

parsing means for parsing a syntax of a source encoded stream to extract a plurality 
of coding parameters firom said source encoded stream; 

detecting means for detecting an error layer having a syntax error in said source 
encoded stream in accordance with a result of a parsing process performed by said parsing 
means; 

variable-length-decoding means for performing a variable-lcngth-decoding process 
on said source encoded stream to generate a variable-length*-decoded stream; 

generating means for generating a predetermined layer having a correct syntax 
which conforms to a motion picture image coding experts group (MPEG) standard; and 

substituting means for substituting said predetermined layer from said generating 
means for said error layer of said variable-length-decoded stream. 

18. A stream processing method comprising the steps of: 

parsing a syntax of a source encoded stream to extract a plurality of coding 
parameters firom said source encoded stream; 

detecting an error layer having a syntax error in said source encoded stream in 
accordance with a result of a parsing process; 

performing a variable-length-decoding process on said source encoded stream to 
generate a variable-length-decoded stream; 

generating a predetermined layer having a correct syntax which conforms to a 
motion picture image coding experts group (MPEG) standard; and 
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substituting said predetennined layer for said error layer of said variable-length- 
decoded stream. 

19. A stream processing apparatus for substitoting a data stream having a con^ 
syntax for a source encoded stream having a syntax error, said apparatus comprising: 

parsing means for parsing a syntax of said source encoded stream to extract a 
plurality of coding parameters from said source encoded stream; 

detecting means for detecting an error macroblock having said syntax error in said 
source encoded stream in accordance with a result of a parsing process performed by said 
parsing means; 

generating means for generating a predetermined data stream comprising variable- 
length-encoded codes having the correct syntax which conforms to a motion picture image 
coding experts group (MPEG) standard; and 

substituting means for switching said predetennined data stream and said source 
encoded stream so that said error macroblock of said source encoded stream is replaced by 
said predetermined data stream. 

20. A stream processing method for substituting a data stream having a correct 
syntax for a source encoded stream having a syntax error, said method comprising the steps 
of: 

parsing a syntax of said source encoded stream to extract a plurality of coding 
parameters from said source encoded stream; 
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detecting an error macroblock having said syntax error in said source encoded 
stream in accordance with a result of a parsing process; 

generating a predetermined data stream comprising variable-length-encoded codes 
having the correct syntax which conforms to a motion picture image coding experts group 
(MPEG) standard; and 

switching said predetermined data stream and said source encoded stream so that 
said error macroblock of said source encoded stream is replaced by said predetermined data 
stream. 

21. A stream processing apparatus for substituting a data stream having a correct 
syntax for a source encoded stream having a syntax error, said apparatus comprising: 

parsing means for parsing a syntax of said source encoded stream to extract a 
plurality of coding parameters &om said source encoded stream; 

detecting means for detecting an error layer having said syntax error in said source 
encoded stream in accordance with a result of a parsing process performed by said parsing 
means; 

generating means for generating a predetermined layer haviag the correct syntax 
which conforms to a motion picture image coding experts group (MPEG) standard; and 

substituting means for switching a data stream comprising said predetermined layer 
and said source encoded stream so that said error layer of said source encoded stream is 
replaced by said predetermined layer. 
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22. A stream processing method for substituting a data stream having a correct 
syntax for a source encoded stream having a syntax error, said method comprising the steps 
of: 

parsing a syntax of said source encoded stream to extract a plurality of coding 
parameters from said source encoded stream; 

detecting an error layer having said syntax error in said source encoded stream in 
accordance with a result of a parsing process; 

generating a predetermined layer having the correct syntax which confomis to a 
motion picture image coding experts group (MPEG) standard; and 

switching a data stream comprising said predetemiined layer and said source 
encoded stream so that said error layer of said source encoded stream is replaced by said 
predetermined layer. 

23. A processing apparatus comprising: 

means for detecting a macroblock in a data stream having a syntax error, 
means for generating a macioblodc having an acceptable syntax; and 
means for replacing the macroblock having said syntax error with said macroblock 
having said acceptable syntax. 

24. A processing method comprising the steps of: 
detecting a macroblock in a data stream having a syntax error; 
generating a macroblock having an acceptable syntax; and 
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replacing the macroblock having said syntax error with said macioblock having said 
acceptable syntax. 
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